Handheld controller with hand detection sensors

ABSTRACT

A handheld controller configured to be held by a user&#39;s hand. The handheld controller comprising a main body, and a handle extending from the main body, wherein the handle has a palm side and a finger side. A control button is positioned on the main body or handle, and a detection sensor is on the handle. The detection sensor is positioned to detect the presence of the finger or palm of a user&#39;s hand engaging the handle. The detection sensor can be a capacitive touch sensor, a proximity sensor or other detection sensor operative to detect the touch or spatial presence of the user&#39;s hand or fingers.

CROSS-REFERENCE TO RELATED APPLICATION(S)

This application claims priority to U.S. Provisional Patent ApplicationNo. 62/273,727, filed Dec. 31, 2015, entitled “Handheld Controller withHand Detection Sensors” which is incorporated in its entirety byreference thereto.

TECHNICAL FIELD

This patent application is directed to handheld controllers and, morespecifically, to virtual reality handheld controllers.

BACKGROUND

In a virtual reality system, a user wears a head-mounted display thatpresents a selected virtual reality (VR) environment in front of theuser's eyes. In some VR systems, a user can manipulate items in thevirtual environment with handheld controllers. The controllers includetracking patterns comprised of a pattern of lights, for example. Thesystem monitors the movement of the tracking patterns with a trackingcamera and reproduces the user's hand movements in the virtualenvironment. However, buttons traditionally used on game controllers,for example, do not typically detect detailed hand movements. Forexample, individual finger movements and gestures, as well as handmovements relative to the controller, are not captured with traditionalbutton configurations.

BRIEF DESCRIPTION OF THE DRAWINGS

Embodiments of the handheld controller with detection sensors introducedherein may be better understood by referring to the following DetailedDescription in conjunction with the accompanying drawings, in which likereference numerals indicate identical or functionally similar elements:

FIG. 1 is an isometric view of a pair of handheld controllers eachincluding hand detection sensors according to a representativeembodiment.

FIG. 2 is an isometric view of a user's right hand grasping theright-hand controller of FIG. 1.

FIG. 3 is an isometric view of the right-hand controller shown in FIGS.1 and 2 as viewed from the handle.

FIG. 4 is a side view and elevation with various components hidden toshow a finger button mounting arrangement.

FIG. 5 is a front isometric view of the handheld controller with variouscomponents hidden to show a finger button mounting arrangement.

FIG. 6 is an isometric view of the handheld controller of FIG. 5 asviewed from above with various components hidden to show the fingerbutton position sensor.

FIG. 7 is a front view in elevation of a handheld controller includinghand detection sensors according to another representative embodiment.

The headings provided herein are for convenience only and do notnecessarily affect the scope or meaning of the claimed embodiments.Further, the drawings have not necessarily been drawn to scale. Forexample, the dimensions of some of the elements in the figures may beexpanded or reduced to help improve the understanding of theembodiments. Moreover, while the disclosed technology is amenable tovarious modifications and alternative forms, specific embodiments havebeen shown by way of example in the drawings and are described in detailbelow. The intention, however, is not to limit the embodimentsdescribed. On the contrary, the embodiments are intended to cover allmodifications, equivalents, and alternatives falling within the scope ofthe embodiments as defined by the appended claims.

DETAILED DESCRIPTION Overview

A handheld controller with touch or proximity detection sensors isdisclosed. In an embodiment, the handheld controller is configured to beheld by a user's hand, the controller includes a main body, a handleextending from the main body, and a control button positioned on themain body or the handle. A detection sensor is on the handle andpositioned to detect the presence of the finger or palm of a user's handengaging the handle. The detection sensor can be a pressure sensor, acapacitive touch sensor, or a proximity sensors to detect the touch orspatial location of the user's fingers relative to the handle.

One embodiment provides a handheld controller comprising a main bodyhaving a thumb surface, a thumbstick extending from the thumb surface, asurrounding ring portion extending from the main body, and a handleextending from the main body. The handle has a palm side and a fingerside. A trigger button is positioned on the main body or handle, and athird-finger button is positioned on the finger side of the handle. Adetection sensor is on the handle and positioned to detect the presenceof the finger or palm of a user's hand engaging the handle and operativeto output a signal corresponding to a presence of the user's handrelative to the handle.

Another embodiment provides a handheld controller comprising a mainbody, and a handle extending from the main body, wherein the handle hasa palm side and a finger side. A trigger button is positioned on themain body or handle. A first detection sensor is on the finger side ofthe handle and positioned to detect the presence of a first one of theuser's fingers relative to the handle. A second detection sensor is onthe finger side of the handle adjacent to the first detection sensor andpositioned to detect the presence of a second one of the user's fingersrelative to the handle. A third detection sensor is on the handle andpositioned to detect the presence of a portion of the user's handrelative to the handle.

GENERAL DESCRIPTION

Various examples of the devices introduced above will now be describedin further detail. The following description provides specific detailsfor a thorough understanding and enabling description of these examples.One skilled in the relevant art will understand, however, that thetechniques discussed herein may be practiced without many of thesedetails. Likewise, one skilled in the relevant art will also understandthat the technology can include many other features not described indetail herein. Additionally, some well-known structures or functions maynot be shown or described in detail below so as to avoid unnecessarilyobscuring the relevant description.

The terminology used below is to be interpreted in its broadestreasonable manner, even though it is being used in conjunction with adetailed description of some specific examples of the embodiments.Indeed, some terms may even be emphasized below; however, anyterminology intended to be interpreted in any restricted manner will beovertly and specifically defined as such in this section.

FIG. 1 illustrates a pair of handheld controllers 100 according to arepresentative embodiment. The pair of handheld controllers 100 includesa right-hand controller 102 and a left-hand controller 104. The primarystructure of the right-hand controller 102 and the left-hand controller104 when held adjacent to each other in a similar orientation, asillustrated, are substantially symmetric with respect to each other.Both the controllers 102/104 are described herein with respect to theright-hand controller 102, as both controllers include the same orsimilar features, albeit in mirror image. The right-hand controller 102includes a main body 106 and a handle portion 108 extending from themain body 106. In some embodiments, a surrounding ring portion 110extends from the main body 106. The controllers 102/104 can be part of aVR system 10, such as the Rift™ available from Oculus™.

As shown in FIG. 2, the right-hand controller 102 includes a thumbstick112, a trigger button 114 and a third-finger button 116. The main body106 includes a thumb surface 118 from which the thumbstick 112 extends.The main body 106 may also include one or more buttons 120 and 122positioned on the thumb surface 118. In some embodiments, the thumbsurface 118 is a substantially planar surface. The handle portion 108extends from the main body 106 on a side generally opposite the triggerbutton 114. The main body 106 and the handle portion 108 areergonomically contoured such that a user's hand 5 can comfortably graspthe handheld controller 102 as illustrated. When the controller 102 isgrasped, the user's thumb 7 (i.e., the first finger) is comfortablypositionable above the main body 106 with the thumb 7 engaging on thethumbstick 112. The user's second or index finger 9 is positioned on thetrigger button 114. The user's third or middle finger 11 operates thethird-finger button 116. The third-finger button 116 is operative todetect whether the user is grasping the handle portion 108 with his orher third-finger 11. In some embodiments, the third-finger button 116can detect various degrees of deflection corresponding to the force orpressure of a user's grip on the handle portion 108.

In some embodiments, the third-finger button 116 is active depending onthe context of an associated virtual environment or game. In otherembodiments, the third-finger button 116 is activated mechanically or byanother sensor. One embodiment could include a palm sensor (e.g.,analogous to a pistol grip safety or grip switch), such that when thepalm sensor detects the user's hand, and the third-finger button 116 isreleased, an output signal indicates an “open-hand gesture.”

In some embodiments, the handle portion 108 can include one or moredetection sensors 125 positioned to detect the presence of the user'spalm or a portion of a finger, indicating that the user is holding thehandle portion 108, indicating how the user is holding the handleportion, or how the user is moving his or her hand relative to thehandle portion. For example, the detection sensor 125 can be acapacitive touch sensor on the handle portion, such as adjacent to thethird finger button 116 or in a position for engagement by the user'sfourth or fifth finger when grasping the handle. A detection sensor 125can be positioned to be engaged by a portion of the user's second finger(i.e., index finger) or third finger (i.e., middle finger) that is onthe handle portion 108 adjacent to the trigger button 114 or thethird-finger button 116, indicating the presence of the user's fingerson the handle portion 108 even if the associated finger has been liftedoff of the trigger button 114 or the third finger button 116. Detectionsensors 125 can be provided on the handle portions corresponding to theposition of all of the user's fingers grasping the handle.

In one embodiment, one or more of the detection sensors 125 areproximity sensors configured to detect the spatial location of theuser's fingers or hand relative to the handle portion 108. For example,the proximity sensor 125 could be used to detect the presence of theuser's finger and the separation distance between the respective fingerand the surfaced of the handle portion 108. The proximity sensors 125can be configured to allow detection of movement of the user's fingersor other portions of the user's hand relative to the handle portion 108.The detected separation distance and/or movement can be used inconnection with signals, commands, or other control signals related tothe hand shape or position of the user's hand or fingers relative to thehandle portion 108.

In some embodiments, the handle portion 108 can include a combination ofpressure sensors, capacitive touch sensors, and/or proximity sensorsthat provide signals to the VR system 10, for example, to initiate acommand or to replicate a hand configuration in a correspondingapparition or avatar.

When the third-finger button 116 is depressed, the system registers thatthe user's hand is closed or grasped around the handle portion 108. Whenthe third-finger button 116 is not depressed, the system can indicate anopen hand gesture. The presence of a gesture can be a signal to the VRsystem 10 to initiate a command or to include the gesture in acorresponding apparition or avatar. The third-finger button 116 allows auser to maintain a grip on the handle portion 108 while still being ableto provide hand grip inputs to the VR system. In another embodiment, thethird button on the handle is positioned for engagement by the user'sring or fourth finger or the pinkie or fifth finger, or a combination ofthe third, fourth and/or fifth fingers. In some embodiments, thethumbstick 112, the trigger button 114, the thumb surface 118, and thebuttons 120 and 122 can be configured to detect other hand and fingergestures as explained in U.S. patent application Ser. No. 14/939,470,titled “METHOD AND APPARATUS FOR DETECTING HAND GESTURES WITH A HANDHELDCONTROLLER,” filed Nov. 12, 2015, and U.S. patent application Ser. No.14/975,049, titled HANDHELD CONTROLLER WITH ACTIVATION SENSORS, filedDec. 18, 2015, all of which are hereby incorporated by reference intheir entireties.

With reference to FIG. 3, the handle portion 108 includes a palm side124, which confronts the palm of the user's hand 5, and a finger side126 opposite the palm side 124 and generally confronts the fingers, suchas the third-finger 11, of the user's hand 5. Accordingly, thethird-finger button 116 is disposed on the finger side 126 of the handleportion 108. As shown in FIG. 4, the third-finger button 116 includes anarm 128 rotatably coupled to the main body 106 via a pivot shaft 130extending along an axis A. With further reference to FIG. 5, the pivotshaft 130 is mounted at an angle with respect to the main body 106 inclevis arms 132 and 134 extending from the main body 106. In someembodiments, a torsion spring 136 is positioned about the pivot shaft130 to return the arm 128 to the extended position and to providetactile feedback to the user's third-finger 11 (see FIG. 2) in the formof a resistive force.

As shown in FIG. 6, the third-finger button 116 includes a detectionfeature, such as a magnet or other detectable member. In the illustratedembodiment, a magnet 140 is mounted on arm 128. A sensor 142 ispositioned inside the handle adjacent the magnet 140. In someembodiments, the sensor 142 is a Hall effect sensor. A Hall effectsensor is a transducer that varies its output voltage in response to amagnetic field. Thus, as the magnet 140 moves closer to the sensor 142,the output voltage varies. Accordingly, the third-finger button 116 isan analog button in that it can detect various degrees of deflectioncorresponding to the force of a user's grip on the handle portion 108and output a signal corresponding to movement of the third-finger button116. In some embodiments, the magnet 140 and the Hall effect sensor 142may be replaced by an on/off switch such as a miniature snap-actionswitch, for example. In some embodiments, movement of the third-fingerbutton 116 can be detected with an inductive proximity sensor or othersuitable type of proximity sensor. In some embodiments, the detectionfeature for use with a proximity sensor can be a location (e.g., targetlocation) on the third-finger button 116.

FIG. 7 illustrates a handheld controller 202 according to arepresentative embodiment. The handheld controller 202 comprises a mainbody 206, a trigger button 210 positioned on the main body 206, and ahandle portion 208 extending from the main body 206 on the side oppositethe trigger button 210. The handle portion 208 has a palm side 224 and afinger side 226. A first pressure sensitive sheet or pad 214 ispositioned on the palm side 224 of the handle portion 208 and a secondpressure sensitive sheet or pad 216 is positioned on the finger side226. The pressure sensitive pads 214/216 are operative to detectcompression of the pads caused by a user's fingers and/or palm, therebyregistering the presence and/or strength of a user's grip around thehandle portion 208. In some embodiments, the handle portion 208 onlyincludes one or other of the first and second pressure sensitive pads214/216.

REMARKS

The above description and drawings are illustrative and are not to beconstrued as limiting. Numerous specific details are described toprovide a thorough understanding of the disclosure. However, in someinstances, well-known details are not described in order to avoidobscuring the description. Further, various modifications may be madewithout deviating from the scope of the embodiments. Accordingly, theembodiments are not limited except as by the appended claims.

Reference in this specification to “one embodiment” or “an embodiment”means that a particular feature, structure, or characteristic describedin connection with the embodiment is included in at least one embodimentof the disclosure. The appearances of the phrase “in one embodiment” invarious places in the specification are not necessarily all referring tothe same embodiment, nor are separate or alternative embodimentsmutually exclusive of other embodiments. Moreover, various features aredescribed which may be exhibited by some embodiments and not by others.Similarly, various requirements are described which may be requirementsfor some embodiments but not for other embodiments.

The terms used in this specification generally have their ordinarymeanings in the art, within the context of the disclosure, and in thespecific context where each term is used. It will be appreciated thatthe same thing can be said in more than one way. Consequently,alternative language and synonyms may be used for any one or more of theterms discussed herein, and any special significance is not to be placedupon whether or not a term is elaborated or discussed herein. Synonymsfor some terms are provided. A recital of one or more synonyms does notexclude the use of other synonyms. The use of examples anywhere in thisspecification, including examples of any term discussed herein, isillustrative only and is not intended to further limit the scope andmeaning of the disclosure or of any exemplified term. Likewise, thedisclosure is not limited to various embodiments given in thisspecification. Unless otherwise defined, all technical and scientificterms used herein have the same meaning as commonly understood by one ofordinary skill in the art to which this disclosure pertains. In the caseof conflict, the present document, including definitions, will control.

What is claimed is:
 1. A handheld controller configured to be held by auser's hand, comprising: a main body; a handle extending from the mainbody, wherein the handle has a palm side and a finger side; a controlbutton positioned on the main body or handle; and a detection sensor onthe handle and positioned to detect the presence of the finger or palmof a user's hand engaging the handle.
 2. The handheld controller ofclaim 1 wherein the detection sensor is on the finger side of the handleand positioned to detect a finger of the user's hand holding the handle.3. The handheld controller of claim 1 wherein the control button is onthe handle, and the detection sensor is adjacent to the control button.4. The handheld controller of claim 1 wherein the detection sensor is acapacitive touch sensor.
 5. The handheld controller of claim 1 whereinthe detection sensor is a proximity sensor.
 6. The handheld controllerof claim 1 wherein the detection sensor is a first detection sensorpositioned to detect a first one of the user's fingers relative to thehandle, and further comprising a second detection sensor on the handlepositioned to detect a second one of the user's fingers relative to thehandle.
 7. The handheld controller of claim 1, further comprising adetection sensor connected to the third-finger button and configured toa presence of the user's fingers relative to the third-finger button. 8.The handheld controller of claim 1 wherein the detection sensor is acapacitive touch sensor or a proximity sensor, and further comprising apressure sensor on the handle.
 9. The handheld controller of claim 1,further comprising a second detection sensor on the main body.
 10. Ahandheld controller, comprising: a main body having a thumb surface; athumbstick extending from the thumb surface; a surrounding ring portionextending from the main body; a handle extending from the main body,wherein the handle has a palm side and a finger side; a trigger buttonpositioned on the main body or handle; a third-finger button positionedon the finger side of the handle; and a detection sensor on the handleand positioned to detect the presence of the finger or palm of a user'shand engaging the handle and operative to output a signal correspondingto a presence of the user's hand relative to the handle.
 11. Thehandheld controller of claim 10 wherein the detection sensor is acapacitive touch sensor.
 12. The handheld controller of claim 10 whereinthe detection sensor is a proximity sensor.
 13. The handheld controllerof claim 10 wherein the detection sensor is adjacent to the third fingerbutton.
 14. The handheld controller of claim 10 wherein the detectionsensor is on the finger side of the handle.
 15. The handheld controllerof claim 10 wherein the detection sensor is a first detection sensorpositioned to detect a first one of the user's fingers relative to thehandle, and further comprising a second detection sensor on the handlepositioned to detect a second one of the user's fingers relative to thehandle.
 16. The handheld controller of claim 10 wherein the detectionsensor is a capacitive touch sensor or a proximity sensor, and furthercomprising a pressure sensor on the handle.
 17. The handheld controllerof claim 10, further comprising a second detection sensor on the mainbody.
 18. A handheld controller, comprising: a main body; a handleextending from the main body, wherein the handle has a palm side and afinger side; a trigger button positioned on the main body or handle; afirst detection sensor on the finger side of the handle and positionedto detect the presence of a first one of the user's fingers relative tothe handle; a second detection sensor on the finger side of the handleadjacent to the first detection sensor and positioned to detect thepresence of a second one of the user's fingers relative to the handle;and a third detection sensor on the handle and positioned to detect thepresence of a a portion of the user's hand relative to the handle. 19.The handheld controller of claim 18, wherein the first detection sensoris a proximity sensor.
 20. The handheld controller of claim 18, furthercomprising a detection sensor on the main body and positioned to detectthe presence of the user's thumb relative to the main body.